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© Image motion vector detector. 



© An image motion vector detection apparatus ef- 
fectively reduces influences of false vectors arising 
at a certain probability and suppresses time lags. An 
image fluctuation stabilizer highly stabilizes images 
or frames without causing unnatural visual feelings. 
An image motion vector detection apparatus com- 
prises means (2 to 5) for detecting motion vectors in 
each of motion vector detection regions defined in 
the whole or part of picture frame, means (12) for 
judging the reliability of the motion vector in each 
region, and signal processing means (11) which, in 
obtaining a motion vector of the whole or part of the 
frame from the motion vectors of the regions and in 
Incase the number of motion vectors judged to be 
^reliable is more than or equal to a predetermined 
^number, outputs a representative value of a set of 
0>the reliable motion vectors as a motion vector of the 
*^ frame. 
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DETECTOR FOR DETECTING MOTION VECTOR OF IMAGE 



BACKGROUND OF THE INVENTION 

This invention relates to motion vector detec- 
tion for image and processing of image for sta- 
bilization against fluctuations. 

Recently, the motion vector detection for image 
and a smoothing signal processing apparatus are 
disclosed in Japanese Patent Unexamined Publica- 
tion No. 61-107886. 

The following explains the conventional motion 
vector detection for images and smoothing signal 
processing apparatus. Fig. 1 is a block diagram of 
the motion vector detection apparatus which uses a 
conventional motion vector smoothing circuit for 
images. Fig. 2 is a diagram used to explain the 
operation of the apparatus. In Fig. 1 numeral 1 is 
an image signal input terminal, 2 is a representa- 
tive point memory which stores signals of pixels on 
representative points in the entered image signal, 
and 3 is a differential-absolute value converter 
which produces the absolute value of the difference 
of inputs. Reference numeral 4 is an accumulating 
adder, 5 is a minimal point detection circuit, 6 is a 
selection means, and 7 is a motion vector smooth- 
ing means. In Figs. 7A and 7B, 8 is a frame, 9a-9d 
are motion vector detection regions, and 10a-10d 
are motion vectors detected in the respective re- 
gions. 

The conventional image motion vector detec- 
tion apparatus arranged as described above will be 
explained for its operation in the following. First, an 
image signal which is continuous in the time do- 
main is entered to the input terminal 1 . The repre- 
sentative point memory 2, for which a plurality of 
representative points in the detection regions 9a-9d 
of the frame 8 are determined in advance, stores 
signals of pixels on the representative points ac- 
cording to the input image signal. The differential- 
absolute value converter 3 evaluates the absolute 
value |AL|(i,j) of the difference between the signal 
at the position of a representative point in a field 
just preceding to a present field and the signal at 
the position with a displacement (by i in the hori- 
zontal direction and j in the vertical direction) from 
the representative point of the present field. The 
accumulating adder 4 includes a table of displace- 
ments (i, j) for the detection regions 9a-9d, and it 
performs cumulative addition for the signal from 
the differential-absolute value converter 3 sepa- 
rately for each displacement (i f j). The result is 
termed a correlation value €|AL|(ij) for displace- 
ment (i,j). The minimal point detection circuit 5 
detects a displacement (i'j') which provides the 
minimum vaiue of the correlation values, and it 
delivers the values as motion vectors 10a-10d in 



the detection regions 9a-9d. The selection means 6 

provides a motion vector of the whole frame from 

the motion vectors 10a-10d in all detection regions. 

The motion vector smoothing. means 7 produces a 
5 value, which is smoothed in the time domain, of the 

motion vector provided in each field on the basis of 

the following equation. 

Vo(k) = W(k)xVi(k) + <1-W(k)) x Vo(k-1) 

(where Vi(k) is the input motion vector of the k-th 
10 field, Vo(k) is the output motion vector of the k-th 

field, and W(k) is a weighting factor of the k-th 

field). 

The operation is to implement the smoothing 
process for the motion vector in the time axis 

75 direction so that, in case the motion vector of the 
whole frame detected by the selection means 6 is 
a false vector, the discontinuity of motion vectors in 
the time domain due to the false vector is reduced 
thereby to improve the property of visibility in case 

20 a so-called motion correction is conducted. 

The W(k) takes 1 in such a case of scene 
changes so as to follow a quick change, and takes 
a value of about 1/8 in a steady state so as to have 
an increased noise elimination effect. 

25 However, when the motion vector detection ap- 

paratus using the conventional image motion vector 
smoothing circuit is used for the stabilization of 
fluctuated images or frames, the following prob- 
lems arise. 

30 The stabilization of fluctuated images is imple- 

mented in such a procedure of storing a field of 
image signal in the memory in advance while de- 
tecting a motion vector of the whole frame of a 
field immediately precedent to a current field, and 

35 shifting or changing the memory read-out position 
(i.e., image position in the picture frame) in a 
direction of motion correction for each field. 

Accordingly, the memory read-out position is 
determined, in principle, from the integrated value 

40 of detected motion vectors. The following explains 
a fluctuation stabilizing operation by the motion 
vector detection apparatus using the conventional 
image motion vector smoothing circuit with refer- 
ence to Figs. 3(a), 3(b) and 3(c). Fig. 3(a) shows an 

45 error in case the motion vector of the whole frame 
in one field detected by the selection means 6 was 
a false vector, Fig. 3(b) shows an error created 
then at the output of the vector smoothing means 
7, and Fig. 3(c) shows an integrated error as a 

so result of the integration operation. 

In one field, in case the motion vector of the 
whole frame detected by the selection means 6 is 
a false vector and an error 20 shown in Fig. 3(a) 
arises, the discontinuity in the time domain of mo- 
tion vectors due to the false vector is reduced as 
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shown in Fig. 3(b). The cumulative error caused in 
the integrated value of the detected motion vectors 
does not have its final integration error 21 reduced 
as shown in Fig. 3(c) since the error of the arising 
false vector is merely smoothed over several fields. 
For this reason, the fluctuation stabilization is di- 
rectly affected by the error of such a false vector, 
resulting in such a malfunctioning as a shift of the 
stabilization image in the direction opposite to that 
of the error. 

The smoothing operation creates a time lag in 
the motion vector, and therefore only low frequency 
components of fluctuations are stabilized with its 
high frequency components being left without be- 
ing stabilized, giving unnatural feelings to viewers. 

As described above, the motion vector detec- 
tion apparatus using the conventional image motion 
vector smoothing circuit, when used for the sta- 
bilization of fluctuated images, involves such defi- 
ciencies as faulty operations and unnatural feelings 
given to viewers. 



SUMMARY OF THE INVENTION 

This invention is intended to solve the fore- 
going prior art problems, and its object is to pro- 
vide an image motion vector detection apparatus 
which effectively reduces influences of errors of 
false vectors arising at a certain probability and 
suppresses the occurrence of time lags, and an 
image fluctuation stabilizer which produces a highly 
stablized image without causing unnatural visual 
feelings. 

The image motion vector detection apparatus 
of this invention comprises means for detecting 
motion vectors in a plurality of motion vector detec- 
tion regions in the whole or part of a field or frame, 
and signal processing means which, with a detec- 
tion of a number of motion vectors judged to be 
reliable in the detection regions more than or equal 
to a specified number, produces a representative 
value of such reliable motion vectors as a motion 
vector of the whole or part of the field. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram of the conventional 
image motion vector detection apparatus; 

Fig. 2 is a diagram explaining the operation 
of the above conventional apparatus; 

Fig. 3 is a diagram explaining the operation 
of the above conventional apparatus as a fluc- 
tuation stabilizer; 

Fig. 4 is a block diagram of an image motion 
vector detection apparatus based on the first em- 
bodiment of this invention; 



Fig. 5 is a block diagram of an image motion 
vector detection apparatus based on the second 
embodiment of this invention; 

Fig. 6 is a block diagram of an image fluc- 
5 tuation stabilizer based on the third embodiment of 
this invention; and 

Fig. 7 is a diagram explaining the operation 
of the image fluctuation stabilizer based on the 
third embodiment of this invention. 

10 

DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

Fig. 4 is a block diagram of the image motion 

75 vector detection apparatus based on the first em- 
bodiment of this invention. In Fig. 4, indicated by 1 
is an image signal input terminal, 2 is a representa- 
tive point memory, which stores signals of pixels at 
representative points in the entered image signal. 

20 Numeral 3 is a differential-absolute value converter, 
which produces the absolute value of the difference 
of inputs. Numeral 4 is a cumulative adder, 5 is a 
minimal point detection circuit, and 11 is a median 
selection means. 12 is a reliability judgement 

25 means, and 13 and 14 are memories. 

The operation of the image motion vector de- 
tection apparatus based on the first embodiment of 
this invention arranged as described above will be 
explained in the following. First, an image signal 

30 which is continuous in the time domain enters to 
the input terminal 1. For the representative-point 
memory 2, a plurality of representative points in 
the detection regions 9a-9d of the frame 8 are 
determined in advance, and it stores signals of 

35 pixels at the positions of representative points in 
the input image signal. The differential-absolute 
value converter 3 evaluates the absolute value 
|AL|(i,j) of the difference between the signal at the 
position of a representative point in a field just 

40 precedent to a current or present field and the 
signal at the position with a displacement (by i in 
the horizontal direction and j in the vertical direc- 
tion) from the representative" point of the present 
field. The cumulative adder 4 includes a table 

45 representative of displacements (i j) in the detection 
regions 9a-9d, and it accumulates signals from the 
differential-absolute value converter 3 separately 
for each displacement (ij) to produce a correlation 
value e|AL|(i,j) for a displacement (ij). The minimal 

so point detection circuit 5 detects a displacement 
(i j ) which provides the minimum value of the 
correlation values, and delivers it as a motion vec- 
tor 10a-10d in each detection region 9a-9d. The 
reliability judgement means 12 implements the 

55 judgement of reliability of motion vectors in each 
region, and delivers such a motion vector, which 
has been judged to be reliable, to the median 
selection means 11 and memory 13. The memory 



3 



5 



EP 0 392 671 A2 



6 



14 stores a set of motion vectors in detection 
regions, which have been judged to be reliable, 
and the output motion vectors of a first precedent 
field and a second precedent field which precedes 
a present field by two. (Hereinbelow a field imme- 
diately precedent to a present field is called as 
"first precedent field", and a field immediately 
precedent to the first precedent field is called as 
"second precedent field".) The memory 13, in case 
one motion vector has been judged to be reliable 
in the detection regions in a present field, holds the 
motion vector until a field which is later than the 
present field by two. The median selection means 
11 produces an output motion vector of the whole 
field on the basis of the outputs of the reliability 
judgement means 12, memory 13 and memory 14 
in the following manner. [It is herein noted that the 
above-referred table is such as defining 64 dis- 
places by 64 horizontalwise detection pixels (i = -7 
-0 - +8) and 16 verticalwise detection lines (j = 
-31 - 0 - + 32). For the reliability judgement of 
motion vectors, a reference may be made to JP-A- 
61-269475, for example. As discussed herein later 
referring to Figs. 7A and 7B, motion vectors of 
detection regions 9a to 9d in Fig. 7A are judged as 
reliable which do not contain moving image por- 
tions. On the other hand, such vectors in Fig. 7B 
are judged as not reliable in the detection regions 
containing moving image portions 9a to 9c]. 

First, in case the number of motion vectors in 
the detection regions which have been judged to 
be reliable in a present field is three or more, a 
median of a set of the reliable motion vectors (the 
value of a magnitude center of the motion vectors, 
or the mean value of two motion vectors nearest to 
the magnitude center of the motion vectors in case 
the number of them is even) is outputted. Such 
vectors are treated for their values independently in 
the horizontal direction and vertical direction, and 
the output vector is represented by the median of 
each set. 

In case the number of motion vectors judged to 
be reliable in the detection regions in the present 
field is two, the output motion vector of a first 
precedent field is added to the set of the motion 
vectors so that the number of the motion vectors in 
total becomes three, and thereafter the median of 
them is outputted. 

In case a single motion vector has been judged 
as reliable in the detection regions in the present 
field the single motion vector is added to the output 
motion vectors of a first precedent field and a 
second precedent field so as to produce a set of 
three reliable motion vectors, and thereafter the 
median of them is outputted. 

However, even if such a single motion vector 
judged as reliable in the detection regions contin- 
ues over three fields or more, motion vectors in the 



detection regions which have been judged to be 
reliable in a first precedent field and a second 
precedent field are added to the single motion 
vector so as to produce a set of three reliable 

5 motion vectors, and thereafter the median of them 
is outputted. (This is to prevent such a mu func- 
tioning in which after consecutive outputs of a 
same value for two fields, the same value is output- 
ted continuously in the successive fields. Namely 

10 under a continued state of a single-motion vector 
judged as reliable in the detection regions over 
several fields and if, the output motion vectors of 
the first precedent field and the second Precedent 
field are added to the single motion vector so as to 

75 produce the set of three motion vectors and there- 
after the median of them is outputted, then the 
mulfunctioning will be caused.) 

In case the number of motion vectors judged 
reliable in the present field is zero; the output 

20 motion vectors of the first precedent field and the 
second Precedent field, and the first precedent 
field output motion vector multiplied by a factor of 
one or less are added so as to produce the set of 
three reliable motion vectors, and thereafter the 

25 median of them is outputted. 

As mentioned above, by making such three 
motion vectors and thereafter producing the 
median of them, even if one of the three motion 
vectors is a false vector, but with the remaining two 

30 vectors being accurately reliable, it is possible to 
selectively output a well accurate vector value with- 
out being affected by the false vector at all. 

Only in case the number of motion vectors 
which have been judged to be reliable in the detec- 

35 tion regions in the present field is less than three, 
the output motion vectors of precedent field(s) be- 
fore a present field or motion vectors judged as 
reliable in the detection regions in such precedent 
fields are added so as to produce the set of three 

40 motion vectors and thereafter a median in the set is 
outputted, so that the probability of the occurrence 
of a time lag in the detected vector is very low. 

For example, supposing the case of two motion 
vectors In the regions which have been judged to 

45 be reliable in the present field. When both of the 
two motion vectors are correct motion vectors in 
the present field, they should have an equal value, 
and therefore the selection of a median of the set 
after adding the output motion vectors in the pre- 

so vious field to the set will result in a selection of a 
correct value of motion vector in the present field, 
and a time lag does not occur. If one of the two 
motion vectors Is a false vector which is largely 
deviated from the motion vector in the present 

55 field, the output motion vector of the previous field 
is added to the set of the two motion vector and 
the median of the set is selected, so that any of 
correct motion vectors in the present field or output 
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motion vector of the precedent field closed to that 
value is outputted, and therefore the influence of 
the false vector can be removed. 

Fig. 5 is a block diagram of another image 
motion vector detection apparatus based on the 
second embodiment of this invention. In Fig. 5, 
numeral 1 is an image signal input terminal, 2 is a 
representative point memory, 3 is a differential- 
absolute value converter, 4 is an accumulating ad- 
der, 5 is a minimal point detection circuit 11, is a 
median selection means, 12 is a relaibility judge- 
ment means, and 13 is a memory. In Fig. 5 circuit 
portions common to those of Fig. 1 are referred to 
by the same numerals. This image motion vector 
detection apparatus will be explained in the follow- 
ing. 

The arrangement and operation of portions in- 
cluding the image signal input terminal 1, repre- 
sentative point memory 2, differential-absolute val- 
ue converter 3, accumulating adder 4, minimal 
point detection circuit 5, and reliability judgement 
means 12 are identical to the first embodiment. 
Subsequently, the reliability Judgement means 12 
implements the judgement of reliability of motion 
vectors in all regions, and motion vectors which 
have been judged to be reliable are outputted to 
the memory 13. The memory 13 stores four vec- 
tors in the order or sequence outputted from the 
reliability judgement means 12, and outputs the 
four vectors to the median selection means 11. The 
median selection means 11 outputs a median of 
the set of four vectors as a motion vector of the 
frame. 

According to this embodiment, in which the 
median of the set of four vectors is outputted as a 
motion vector of the frame, if one vector of the set 
is a false vector, a stabilized motion vector can be 
detected without being affected by the false vector. 

In case the number of vectors provided by the 
reliability judgement means 12 for the present field 
is four, all of the four vectors provided by the 
memory 13 have been detected in the present 
field, and therefore the output made of the median 
of the set of four vectors does not involve a time 
lag. 

Even in case the number of vectors provided 
by the reliability judgement means 12 for the 
present field is less than four, the number of vec- 
tors is increased to four by adding to them vectors 
provided by the reliability judgement means 12 
before the present field, so that the median of the 
four vectors is outputted as a motion vector of the 
frame, whereby the influence of a false vector can 
be eliminated. 

Accordingly, the effectiveness which is almost 
identical to the first embodiment can be accom- 
plished more simply. 

Fig. 6 is a block diagram of an image fluc- 



tuation stabilizer according to the third embodiment 
of this invention. In Fig. 6, numeral 1 is an image 
signal input terminal, 2 is a representative point 
memory, 3 is a differential-absolute value convert- 
5 er, 4 is an accumulating adder, 5 is a minimal point 
detection circuit, 11 is a median selection means, 

12 is a reliability judgement means, 13 and 14 are 
memories, 15 is a field memory, 17 is a reading 
control means, and 18 is an interpolation-enlarge- 

w ment means. In Fig. 3. circuit portions same as 
those of Fig. 4 are referred to by the same nu- 
merals. A section of arrangement including the 
representative point memory 2, differential-absolute 
value converter 3, accumulating adder 4, minimal 

75 point detection circuit 5, median smoothing means 
11, reliability judgement means 12, and memories 

1 3 and 1 4 is a motion vector detection means. 

The operation of the image fluctuation stabilizer 
arranged as above will be explained in the follow- 
20 ing. 

First, an image signal is applied from the input 
terminal 1. The field memory 15 stores the image 
signal for one field. 

The motion vector detection means 16, which 

25 is identical in arrangement and operation to the first 
embodiment and the motion vector detection 
means of Fig. 4, detects a motion vector of the 
whole frame in a present field relative to the prece- 
dent field, and outputs a signal of the vector to the 

30 reading control means 17. 

The reading control means 17 responds to the 
entered motion vector signal to shift the memory 
reading position in a direction for correcting or 
adjusting the movement relative to the reading po- 

35 sition for a first precedent field, and performs such 
processings as centering and clipping so that the 
reading position does not go out of the frame, and 
outputs the result to the interpolation-enlargement 
means 18. 

40 The interpolation-enlargement means 18 read 

out image signals of a portion specified by the 
entered reading position frame the field memory 
15, implements the enlarged interpolation for the 
readout image signals to output as image signals 

45 for one frame. These means may be implemented, 
for example, with reference to article "Picture cen- 
ter correction" written on pages 43 to 48 by Japa- 
nese TV Society Technical Report dated May 28, 
1987. 

50 Figs. 7A and 7B are simple illustrations of 

frames used to explain the above operation in more 
detail. In Figs. 7A and 7B, 8 is a frame, 9a, 9b, 9c 
and 9d are a plurality of motion vector detection 
regions included in the motion vector detection 

55 means 16, and 10a, 10b, 10c and 10d are motion 
vectors detected in the respective regions. 19a, 
19b and 19c are moving objects in the frame 
having movements different from the movement of 
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whole image in the frame. 

Fig. 7A is a case of no moving objects in the 
frame. In this case, the motion vector detection 
means 16 judges that all vectors 10a, 10b. 10c and 
10d detected in the respective detection regions 
9a, 9b, 9c and 9d are reliable, and outputs a 
median among them as an output motion vector of 
the frame. Accordingly, even in case one of the 
detected vectors 10a, 10b, 10c and 10d is a false 
vector, a stabilized motion vector is detected by 
being rid of its influence, and a satisfactory cor- 
rected stabilized frame is presented. In case there 
is no moving objects in the frame, as shown in the 
7A, a small residual of correction in the stabilized 
frame can easily visually be noted, causing unnatu- 
ral feelings. In the case, however, the motion vector 
provided by the motion vector detection means 16 
has no time lag, and therefore there airses no 
residual of correction due to a time lag in the 
stabilized frame. 

Fig. 7B is a case of many moving objects 
existing in the frame. In this case, due to moving 
objects 19a, 19b and 19c, the motion vector detec- 
tion means 16 judges that only a vector 10d among 
vectors 10a-10d detected in the respective detec- 
tion regions 9a-9d is reliable. Accordingly a set of 
three reliable motion vectors is formed of the 10d, 
the outputs of the first precedent field and the 
second precedent field or a motion vector in each 
region which has been judged to be reliable, and a 
median in the set is outputted as a motion vector of 
the frame. Accordingly, even in case the detected 
vector 10d in a present field is a false vector, a 
stabilized motion vector is detected by being rid of 
influences from the false vector, and a satisfactory 
stabilized frame is presented. In this case, how- 
ever, the motion vector produced by the motion 
vector detection means 16 may possibly have a 
time lag, and it results in instabilized fluctuation 
residual of high frequency components due to the 
time lag in the fluctuation stabilized frame. How- 
ever, in case many moving objects images are 
produced in the frame, as shown in Fig. 7B. a 
small residual of instabilization is hardly recognized 
on the stabilized frame and therefore it does not 
cause unnatural feelings. 

As described, according to this embodiment, 
only in case the number of motion vectors of 
regions which have been judged to be reliable in a 
present field is less than a specified number, out- 
put motion vectors of precedent fields inclusive of 
a first precedent field or motion vector judged 
reliable in regions of such precedent fields are 
added to produce a set of motion vectors a number 
of which becomes a specified number or more and 
a representative vector value in the set is outputted 
by the median selection means 11. whereby the 
influence of errors caused by a false vector is 



suppressed low, and instabilized fluctuation resid- 
ual occurs only in the case of the drastic move- 
ment of moving objects in the frame or in the case 
of much noises. In the case such a small fluc- 

5 tuation residual does hardly significantly causes 
unnatural ness in the visual observation. On the 
other hand, in the case of less moving objects and 
noises in the frame, in which such small fluctuation 
residual can easily be noted, the fluctuations can 

10 be stabilized sufficiently low, whereby a satisfac- 
tory stabilized image can be presented for all con- 
ditions of various moving images. 

Although in the third embodiment the motion 
vector detection means 16 is arranged identically 

T5 to the motion vector detection apparatus of the first 
embodiment, it is obvious that the means is ar- 
ranged identically to the motion vector detection 
apparatus of the second embodiment to achieve 
the same effectiveness. 

20 Although in the first, second and third embodi- 

ments there are four detection regions provided in 
the frame, the number of regions may be other 
than four. 

Although in the first, second and third embodi- 
25 ments the minimum number of motion vectors to 
produce the median by the median selection 
means 1 1 is three and four, respectively, a different 
number of such vectors above three may be adopt- 
ed. 

30 Although in the first, second and third embodi- 

ments the median selection means 11 outputs the 
median as a representative value, it may be de- 
signed such that motion vectors distant from the 
general trend of such a set are excluded from the 
35 set and a representative value is determined from 
the remaining motion vectors. For example, assum- 
ing a set of eight motion vectors, values of four of 
them closer to the magnitude center of them are 
averaged to produce a representative value of the 
AO set. Alternatively, in selecting four vectors from 
among a set of eight motion vectors, they are 
selected such that the sum of distances between 
the selected four vectors is minimal, and a mean 
value of the four vectors is outputted as a repre- 
ss sentative value of the set. 

Although in the first, second and third embodi- 
ments the motion vectors produced in a first prece- 
dent field and the like are added in the case the 
number motion vectors judged as reliable in the 
so detection regions in a present field is less than 
three, a motion vector of the present field predicted 
from such outputs of the first precedent field and 
the second precedent field may be added to pro- 
duce the vector set. For example, an added vector 
55 may be produced by subtracting the output vector 
the second precedent field from the output vector 
multiplied by two of the first precedent field may 
be added to the set. 
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Although in the first, second and third embodi- 
ments the representative point memory 2, 
differential-absolute value converter 3, accumulat- 
ing adder 4 and minimal point detection circuit 5 
are used to detect a plurality of motion vectors of 5 
two consecutive fields by "a so-called representa- 
tive point matching method" and by providing a 
plurality of detection regions in one frame, and the 
detected results are supplied to the median selec- 
tion means 11 and memory 13, they may be re- 10 
placed with other means capable of detecting a 
plurality of motion vectors. For example "a so- 
called all-point matching method" or "gradient 
method" may be used in place of the representa- 
tive point matching method. 75 

As mentioned above, the image motion vector 
detection apparatus of this invention determines a 
representative value of a set of motion vectors by 
removing those distant from the general trend of 
the set, whereby it is highly effective for eliminating 20 
the influence of possible false or unreliable vectors 
in the set, and the apparatus determines a repre- 
sentative value from among motion vectors when 
the number of motion vectors judged as reliable in 
a present field is more than a predetermined num- 25 
ber, whereby a time lag does not arise in the 
output motion vector, and even if the number of 
motion vectors judged as reliable in the present 
field is less than the predetermined number due to 
moving objects and noises in the frame, motion 30 
vectors are suppremented by using motion vectors 
in regions, which have been judged to be reliable, 
and output vectors of precedent fields thereby to 
determine a representative value among them, 
whereby it is highly effective for eliminating influ- 35 
ences of a false vector included in the set 

Accordingly, the motion vector produced by 
the apparatus has its errors minimized and its time 
lag suppressed thoroughly in all conditions of even 
varying images, whereby it is highly effective in aq 
achieving a satisfactory result when used for such 
image processings as motion correction and cod- 
ing and for the control of other equipments. 

The image fluctuation stabilization apparatus of 
this invention uses the above-mentioned inventive . 45 
image motion vector detection apparatus, whereby 
the residual of instabilization of high frequency 
components of fluctuations arises only in the case 
of drastic movement of moving objects in the frame 
or significant noises, and a small residual flue- 50 
tuation of these cases does not significantly cause 
unnatural feelings with the picture frame, and in 
case even a small residual fluctuation is easily 
noted by viewers, accurate correction can be im- 
plemented up to a high frequency components of 55 
fluctuations. Accordingly, a satisfactory fluctuation 
stabilized image can be produced in all conditions 
of image variations. 



Claims 

1 . An image motion vector detection apparatus 
comprising means (2 to 5) which, for the whole or 
part of a frame, with a plurality of motion vector 
detection regions being provided therein, detects 
motion vectors in each region in an image signal 
inputted continuously in the time domain, means 
(12) for judging reliability of the motion vectors in 
each region, and signal processing means (11) 
which, in case the number of motion vectors in a 
region judged to be reliable is more than or equal 
to a predetermined number in obtaining a motion 
vector of the whole or part of the frame from the 
motion vectors provided in the regions, outputs a 
representative value of the set of these motion 
vectors as a motion vector of the frame. 

2. An apparatus according to claim 1 , wherein 
the representative value is a median of the set. 

3. An image motion vector detection apparatus 
comprising means (2 to 5) which, for the whole or 
part of a frame, with a plurality of motion vector 
detection regions being provided therein, detects 
motion vectors in each region in an image signal 
inputted continuously in the time domain, means 
(12) for judging reliability of the motion vectors in 
each region, and signal processing means (11, 13, 
14) which, in case the number of motion vectors in 
the regions judged to be reliable is less than a 
predetermined number in obtaining a motion vector 
of the whole or part of the frame from the motion 
vectors provided in the regions, outputs a repre- 
sentative value of the set of motion vectors, added 
by motion vectors of precedent fields before a 
present field as a motion vector of the frame. 

4. An apparatus according to claim 3, wherein 
the representative value is a median of the set. 

5. An apparatus according to claim 3, wherein 
motion of the precedent fields before the present 
field are added in the order of newness to the set 



7 



EP 0 392 671 A2 



FIG. I PRIOR ART 



7 



J 



2 



REPRESENTATIVE 
POINT MEMORY 



DIFFEREf 


MTIAL- 
E R VALUE 






CUMULATIVE 
ADDITION 






MINIMAL POINT 
DETECTION 






SELECTION 






SMOOl 


"HING 



EP 0 392 671 A2 



FIG. 2 PRIOR Ah i 

-9b 



-t 



9d 



V 



8 



cr 
O 
cr 
cr 

LU 



FIG. 3 PRIOR ART 
20 




TIME 
(FIELD) 



cr 
o 
cr 
cr 

LU 



TIME 
(FIELD) 




EP 0 392 671 A2 



FIG. 4 



3- 
4- 



DIFFERENTIAL- 
ABSOLUTE VALUE 
CONVERTER 



CUMULATIVE 
ADDITION 



MINIMAL POINT 
DETECTION 



RELIABILITY 
JUDGEMENT 



I I 



MEDIAN 
SELECTION 



REPRESENTATIVE k" ' 
POINT MEMORY 



13 

_1 



MEMORY 



MEMORY 



-14 



EP 0 392 671 A2 



FIG. 5 



DIFFERENTIAL- _ 
ABSOLUTE VALUE 
CONVERTER 



CUMULATIVE 
ADDITION 



MINIMAL POINT 
DETECTION 



RELIABILITY 
JUDGEMENT 



MEMORY 



MEDIAN 
SELECTION 



2 

3 <L 



REPRESENTATIVE 
POINT MEMORY 



EP 0 392 671 A2 



F ! G. 6 




3-vJ 



DIFFERENTIAL- 
ABSOLUTE VALUE 
CONVERTER 



4-v 



18 



± 



CUMULATIVE 
ADDITION 



31 



12^ 



MINIMAL POINT 
DETECTION 

i ~ 



RELIABILITY 
JUDGE MENT 

\ 



MEDIAN 
SELECTION 



INTERPOLATION 
ENLARGEMENT 



READING 
POSITION 
CONTROL 



REPRESENTATIVE 
POINT MEMORY 



13 

S 



MEMORY 



MEMORY 



T 



14 



16 



•17 



EP 0 392 671 A2 




• 



J 



Europaisches Patentamt 
European Patent Office 
Office europeen des brevets 



© Publication number: 



0 392 671 A3 



® 



EUROPEAN PATENT APPLICATION 



© Application number: 90302783.7 
@ Date of filing: 15.03.90 



® int. CIA H04N 5/14, G06F 15/70, 
H04N 7/137 



© Priority: 20.0a89 JP 68205/89 


© Applicant: MATSUSHITA ELECTRIC 


© Date of publication of application: 


INDUSTRIAL CO., LTD. 


1006, Oaza Kadoma 


17.10.90 Bulletin 90/42 


Kadoma-shi, Osaka-fu, 571 (JP) 


(£) Designated Contracting States: 


® Inventor: Ishii, Hirofumi 


DE FR GB 


107, Yagumokitamachi-2-chome 




Moriguchi-shi(JP) 


(§) Date of deferred publication of the search report: 


inventor: Morimura, Atsushi, Ekuseru Haitsu 


02.01.92 Bulletin 92/01 


Dainigakuenmae 309, 540-10, 




Gakuennaka-4-chome 




Nara-shi(JP) 




® Representative: Votier, Sidney David et al 




CARPMAELS & RANSFORD 43, Bloomsbury 




Square 




London WC1A 2RA(GB) 



@ Image motion vector detector. 



CO 
< 

CO 

CNI 
O) 
CO 



® An image motion vector detection apparatus ef- 
fectively reduces influences of false vectors arising 
at a certain probability and suppresses time lags. An 
image fluctuation stabilizer highly stabilizes images 
or frames without causing unnatural visual feelings. 
An image motion vector detection apparatus com- 
prises means (2 to 5) for detecting motion vectors in 
each of motion vector detection regions defined in 
the whole or part of picture frame, means (12) for 
judging the reliability of the motion vector in each 
region, and signal processing means (11) which, in 
obtaining a motion vector of the whole or part of the 
frame from the motion vectors of the regions and in 
case the number of motion vectors judged to be 
reliable is more than or equal to a predetermined 
number, outputs a representative value of a set of 
the reliable motion vectors as a motion vector of the 
frame. 
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